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A  broad  program  of  forward-looking  research  was  pursued  within  the 
context  of  this  Young  Investigator  grant.  The  emphasis  of  the  research  was 
on  the  development  of  high  performance,  very  low  complexity  techniques 
for  reliable  communication  over  a  broad  range  of  realistic  wireless  and  wired 
networks.  A  unifying  theme  in  the  approaches  to  these  problems  has  been 
an  integration  of  interrelated  perspectives  from  communication  theory,  in¬ 
formation  theory,  signal  processing  theory,  and  control  theory,  together  with 
the  infusion  of  new  concepts  and  ideas  from  emerging  theories  of  nonlinear 
dynamics,  chaos,  and  fractal  geometry. 

As  one  component  of  the  research,  we  developed  promising  new  and 
bandwidth-efficient  classes  of  time,  frequency,  and  space  diversity  strate¬ 
gies  for  single-  and  multi-user  wireless  communication  in  multipath  fading 
environments.  A  particular  focus  was  our  pioneering  investigation  of  tech¬ 
niques  for  efficient  space-time  coding,  i.e.,  algorithms  for  exploiting  multiple- 
element  transmitter  antenna  arrays  in  wireless  networks.  The  techniques  we 
developed  and  analyzed  offer  dramatic  improvements  in  network  reliability 
with  very  little  computational  complexity,  even  when  the  network  is  sub¬ 
ject  to  tight  delay  amd  bandwidth  constraints.  Design  techniques  for  both 
low-complexity  coded  and  uncoded  systems  were  developed,  along  with  fun¬ 
damental  performance  limits.  Among  other  important  results,  we  estab¬ 
lished  that  there  are  significant  benefits  to  designing  such  adaptive  arrays 
to  take  advantage  of  even  very  limited  channel  state  information.  Specific 
space-time  coding  algorithms  were  developed  for  this  scenario,  and  show  a 
dramatic  performance  enhancement  over  the  best  codes  for  channels  when 
no  channel  state  information  is  available. 

Also  within  this  component  of  the  research,  we  developed  a  host  of 
near-far  resistant  receiver  structures  for  use  with  both  conventional  and 
recently-introduced  spread-signature  CDMA  systems.  In  this  area,  we  have 
develeloped  novel  recursive  linear  equalization  algorithms  and  techniques 
for  equalization  based  on  iterative  interference  cancellation.  The  iterative 
techniques  correspond  to  a  “tmbo-style”  receiver  structures  for  wireless  com¬ 
munication  systems  subject  to  multipath  fading  effects.  In  these  receivers, 
equalization,  demodulation  and  decoding  are  performed  via  an  efficient,  low- 
complexity  batch-interative  algorithm,  which  provides  a  monotonically  im¬ 
proving  progression  of  symbol  estimates  that  can  be  terminated  at  as  desired 
to  meet  fidelity  or  computation  constraints.  Our  results  showed  that  effec¬ 
tively  optimum  decoding  performance  can  in  principle  be  achieved  using 
these  approaches  with  dramatically  less  computational  complexity  than  has 
traditionally  been  required.  Moreover,  preliminary  experiments  on  Navy 
underwater  acoustical  communication  data  yielded  promising  results. 
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Another  component  of  the  project  explored  the  use  of  nonlinear  dynamics 
and  chaos  in  the  design  of  innovative  analog  error-protection  codes  for  com¬ 
munications  applications.  In  the  chaos  context,  we  developed  communication- 
theoretic  evidence  that  the  properties  of  chaotic  dynamical  systems  make 
them  useful  for  channel  coding  in  a  variety  of  practical  communication  appli¬ 
cations.  To  illustrate  this,  a  novel  analog  code  based  on  tent  map  dynamics 
and  having  a  fast  decoding  algorithm  was  developed  for  use  on  unknown, 
multiple,  and  time-varying  signal-to-noise  ratio  (SNR)  channels,  which  are 
useful  models  for  many  practical  low-delay  wireless  links.  This  code  was 
shown  to  be  an  attractive  alternative  to  both  digital  codes  and  linear  modu¬ 
lation  in  such  scenarios.  Several  properties  and  interpretations  of  the  codes 
were  developed,  along  with  some  methods  for  their  optimization. 

Also  within  the  context  of  nonlinear  dynamics,  we  undertook  a  investi¬ 
gation  of  potential  nontraditional  applications  of  soliton  theory  to  the  devel¬ 
opment  of  modulation  and  demodulation  techniques  for  wireless  and  other 
channels.  This  work  revealed  that  soliton  theory  can  also  be  used  to  create 
novel  analog  codes  with  some  intriguing  performance  characteristics.  While 
preliminary  in  nature,  these  results  suggest  that  it  may  be  possible  to  de¬ 
velop  practical  new  codes  out  of  such  a  framework. 

Another  component  of  the  research  investigated  the  use  of  fractal  traffic 
models  in  the  design  amd  management  of  efficient,  next-generation  packet- 
switched  communication  networks.  In  this  area,  we  developed  novel  mul¬ 
tiscale  methods  for  analyzing  packet-switched  data  networks  with  bursty 
traffic  exhibiting  fractal  behavior.  Exploiting  insights  from  this  analysis,  we 
then  used  similar  methods  to  develop  complementary  new  multiscale  traffic 
management  strategies  for  more  efficiently  routing  and  serving  packets  in 
such  networks. 

In  a  different  dimension  of  the  research,  we  developed  novel  techniques 
for  efficiently  exploiting  the  availability  of  feedback  in  communication  net¬ 
works  due  to  duplex  link  structure.  In  particular,  new  ultra-low  complexity 
coding  algorithms  were  developed  for  reliable  communication  over  unreliable 
channels  that  exploit  the  availability  of  such  feedback.  A  unique  feature 
of  these  methods  is  that  they  adapt  familiar,  computationally  extremely 
efficient  source  coding  algorithms  for  channel  coding  applications.  These 
codes,  which  are  based  on  an  efficient  iterative  compressed-error  cancella¬ 
tion  framework,  are  capacity-achieving  in  the  sense  that  the  associated  error 
probabilities  decay  exponentially  with  average  blocklength  at  any  rate  be¬ 
low  the  channel  capacity.  Moreover,  these  schemes  are  maximally  optimal 
in  the  sense  that  for  a  given  channel,  the  error  exponent  associated  with 
these  schemes  is  the  best  possible  exponent  achievable  by  any  scheme. 
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Generalizations  of  these  algorithms  were  developed  for  particularly  harsh 
channel  models  characteristic  of  DoD  applications.  In  particular,  the  class 
of  practical,  low-complexity,  variable-rate  coding  schemes  was  extended  to 
channels  with  memory,  both  known  and  unknown.  These  codes  also  re¬ 
quire  only  a  fixed  number  of  computations  per  input  sample  independent  of 
bloddength.  For  unknown  channels,  new  universal  (blind)  communication 
algorithms  that  integrate  Lempel-Ziv  type  source  coding  as  an  integral  part 
of  their  processing  were  developed.  Remarkably,  these  algorithms  achieve 
performance  efiectively  equal  to  that  possible  if  the  channel  characterstics 
were  known  a  priori,  yet  without  requiring  the  use  of  any  training  data. 

Extensions  to  multiple-acccess  wireless  networks  were  also  developed,  as 
were  variants  that  allow  the  feedback  rate  to  be  optimized  as  a  function  of 
the  application  of  interest.  These  extensions  also  appear  to  be  promising  for 
a  variety  of  wireless  and  related  applications. 

In  the  context  of  sensor  networks  specifically,  we  developed  practical, 
new,  low-complexity  coding  and  estimation  algorithms  for  wireless  sensor 
networks.  These  algorithms  appear  to  be  attractive  for  a  wide  range  of  mil¬ 
itary  applications.  These  involve  the  use  of  novel  dynamic  quantizer  bias 
control  techniques  we  have  developed  that  were  motivated  by  stochastic  res¬ 
onance  phenomena  observed  in  biological  sensor  systems  prevalent  in  nature. 
A  featiure  of  these  techniques  is  that  they  are  extremely  economical  in  their 
use  of  power  at  the  sensor. 

Finally,  at  the  end  of  the  grant  we  began  to  develop  and  evaluate  a  highly 
promising  new  class  of  highly  robust  and  efficient  information  embedding 
techniques  for  hiding  data  in  a  variety  of  different  types  of  signals,  ranging 
from  speech  and  video  waveforms,  to  a  variety  of  types  of  imagery  and  graph¬ 
ics.  Important  applications  of  this  versatile  technology  arise  in  a  variety  of 
Navy  contexts,  ranging  from  covert  communication  (e.g.,  embedding  digital 
messages  in  acoustic  waveforms  corresponding  to  underwater  biologic  signals 
for  LPD  ship-to-ship,  ship-to-sub,  or  ship-to-shore  communication),  to  anti¬ 
spoofing  and  data  authentication  (e.g.,  embedding  information  into  a  digi¬ 
tally  tranmitted  military  map  or  chart  that  would  enable  the  receiving  user 
to  determine  whether  it  had  been  tampered  with),  to  backward-compatible 
upgrading  of  legacy  communication  infrastructure  (e.g.,  embedding  digital 
enhancement  information  on  top  of  the  analog  transmission  format  corre¬ 
sponding  to  a  pre-existing  wireless  or  wireline  communication  system).  The 
specific  techniques  being  developed  for  these  applications  involve  the  use  of 
a  natural  ’’dither  modulation”  strategy  for  creating  indexed  familes  of  quan¬ 
tizers.  Analysis  has  revealed  that  fundamental  information  theoretic  limits 
on  information  embedding  can  be  approached  arbitrarily  closely  using  these 
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methods.  Much  work  and  many  important  issues  remain  to  be  explored  on 
this  topic. 

The  results  for  this  reporting  period  are  described  in  detail  in  the  fol¬ 
lowing  theses,  patent,  and  papers. 

1.  A.  Narula,  M.  D.  Trott,  and  G.  W.  Wornell,  “Information-Theoretic 
Analysis  of  Multiple- Antenna  TVansmission  Diversity  for  Fading  Chan¬ 
nels,”  in  Proc.  Int.  Symp.  Inform.  Theory  and  Appl.  (Victoria, 
Canada),  Sept.  1996. 

2.  S.  H.  Isabelle  and  G.  W.  Wornell,  “Recursive  Multiuser  Equalization 
for  CDMA  Systems  in  Fading  Environments,”  in  Proc.  Allerton  Conf. 
Commun,  Contr.,  Signal  Processing,  (Illinois),  Oct.  1996. 

3.  B.  Chen  and  G.  W.  Wornell,  “EflScient  Channel  Coding  for  Analog 
Sources  using  Chaotic  Systems”  in  Proc.  IEEE  GLOBECOM,  (Lon¬ 
don),  vol.  1,  pp.  131-135,  Nov.  1996. 

4.  J.  M.  Ooi  and  G.  W.  Wornell,  “Decentralized  Control  of  a  Multiple 
Access  Broadcast  Channel:  Performance  Bounds,”  in  Proc.  Int.  Conf. 
Dec.  Control,  (Japan),  Dec.  1996. 

5.  G.  W.  Wornell  and  M.  D.  TVott,  “Efficient  Signal  Processing  Tech¬ 
niques  for  Exploiting  Transmit  Antenna  Diversity  on  Fading  Chan¬ 
nels,”  in  IEEE  Trans.  Signal  Processing,  Special  Issue  on  Signal  Pro¬ 
cessing  Advances  in  Communications,  Jan.  1997. 

6.  Lam,  Warren  M.,  “Multiscale  Methods  for  the  Analysis  and  Applica¬ 
tion  of  Fractal  Point  Processes  and  Queues,”  Ph.D.  thesis.  Dept.  Elec. 
Eng.  Comp.  Sci.,  MIT,  Feb.  1997. 

7.  S.  H.  Isabelle  and  G.  W.  Wornell,  “Efficient  Multiuser  Detectors  for 
Unknown  Intersymbol  Interference  Channels,”  in  Proc.  Signal  Process¬ 
ing  Workshop  on  Signal  Processing  Advances  in  Wireless  Commun., 
(Paris),  Apr.  1997. 

8.  S.  Beheshti  and  G.  W.  Wornell,  “Iterative  Interference  Cancellation 
and  Decoding  for  Spread-Signature  CDMA  Systems,”  in  Proc.  Vehic. 
Tech.  Conf.,  (Phoenix),  May  1997. 

9.  J.  M.  Ooi  and  G.  W.  Wornell,  “Fast  Iterative  Coding  for  Feedback 
Channels,”  in  Proc.  IEEE  Int.  Sympo.  Inform.  Theory,  (Ulm,  Ger¬ 
many),  June  1997. 
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10.  S.  H.  Isabelle  and  G.  W.  Wornell,  “Statistical  Analysis  and  Spectral 
Estimation  Techniques  for  One-Dimensional  Chaotic  Signals,”  IEEE 
Trans.  Signal  Processing,  vol.  45,  no.  6,  pp.  1495-1506,  June  1997. 

11.  J.  N.  Laneman,  “Channel  Estimation  and  Equalization  for  Spread- 
Response  Precoding  Systems  in  Fading  Environments,”  S.M.  thesis. 
Dept.  Elec.  Eng.  Comp.  Sci.,  MIT,  June  1997. 

12.  H.  C.  Papadopoulos  and  G.  W.  Wornell,  “Distributed  Estimation 
Techniques  for  Wireless  Sensor  Networks,”  in  Proc.  Allerton  Conf. 
Commun.,  Gontr.,  Signal  Processing,  (Illinois),  Sept.  1997.  (invited 
paper) 

13.  J.  M.  Ooi,  S.  M.  Verbout,  J.  T.  Ludwig,  and  G.  W.  Wornell,  “A 
Separation  Theorem  for  Periodic  Sharing  Information  Patterns  in  De¬ 
centralized  Control,”  IEEE  Trans.  Automat.  Contr.,  vol.  42,  no.  11, 
pp.  1546-1549,  Nov.  1997. 

14.  J.  M.  Ooi,  “A  Framework  for  Low-Complexity  Communication  over 
Channels  with  Feedback,”  Ph.D.  thesis.  Dept.  Elec.  Eng.  Comp.  Sci., 
MIT,  Feb.  1998. 

15.  J.  N.  Laneman  and  G.  W.  Wornell,  “Robust  Equalization  for  Spread- 
Response  Preceding  Systems,”  in  Proc.  Int.  Conf.  Acoust.,  Speech, 
Signal  Processing,  (Seattle),  May  1998. 

16.  B.  Chen  and  G.  W.  Wornell,  “System,  Method,  and  Product  for  Infor¬ 
mation  Embedding  Using  an  Ensemble  of  Non-Intersecting  Embedding 
Generators,”  US  Patent  filed  May  21,  1998. 

17.  H.  C.  Papadopoulos,  G.  W.  Wornell  and  A.  V.  Oppenheim,  “Low- 
Complexity  Digital  Encoding  Strategies  for  Wireless  Sensor  Networks,” 
in  Proc.  Int.  Conf.  Acoust,  Speech,  Signal  Processing,  (Seattle),  May 
1998. 

Papadopoulos,  Haralabos  C.,  ’’Efficient  Digital  Encoding  and  Estima¬ 
tion  of  Noisy  Signals,”  PhD  thesis,  MIT,  Cambridge,  MA,  June  1998. 

18.  B.  Chen  and  G.  W.  Wornell,  “Analog  Error-Correcting  Codes  Based 
on  Chaotic  Dynamical  Systems,’’  IEEE  Trans.  Commun.,  vol.  46,  no. 

7,  pp.  881-890,  July  1998. 
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19.  J.  M.  Ooi  and  G.  W.  Wornell,  “Further  Results  on  Fast  Iterative  Cod¬ 
ing  for  Feedb^  Channels:  Multiple- Access  and  Partial-Feedback”,  in 
Int.  Symp.  Information  Theory,  Aug.  1998. 

20.  M.  J.  Lopez  and  G.  W.  Wornell,  “IVansmitter  Antenna  Array  Broad¬ 
casting  with  Side  Information”,  in  Int  Symp.  Information  Theory, 
Aug.  1998. 

21.  S.  Beheshti,  S.  H.  Isabelle,  and  G.  W.  Wornell,  “Joint  Intersymbol  and 
Multiple-Access  Interference  Suppression  Algorithms  for  CDMA  Sys¬ 
tems”  European  Transactions  on  Telecommunications,  Special  Issue 
on  Code-Division  Multiple- Access  Techniques  for  Wireless  Communi¬ 
cation  Systems  (invited  paper),  vol.  9,  no.  5,  pp.  403-418,  Sept./Oct. 
1998. 

22.  A.  Narula,  M.  J.  Lopez,  M.  D.  TVott,  and  G.  W.  Wornell,  “Efficient 
Use  of  Side  Information  in  Multiple- Antenna  Data  IVansmission  over 
Fading  Channels,”  IEEE  J.  Select.  Areas  Commun.,  Issue  on  Signal 
Processing  for  Wireless  Communications,  vol.  16,  no.  8,  pp.  1423-1436, 
Oct.  1998. 

23.  J.  M.  Ooi  and  G.  W.  Wornell,  “Fast  Iterative  Coding  Techniques  for 
Feedback  Channels,”  IEEE  Trans.  Inform.  Theory,  vol.  44,  no.  7,  pp. 
2960-2976,  Nov.  1998. 

24.  B.  Chen  and  G.  W.  Wornell,  “Digital  Watermarking  and  Information 
Embedding  using  Dither  Modulation,”  in  Proc.  IEEE  Workshop  on 
Multimedia  Signal  Processing,  Dec.  1998. 

25.  B.  Chen  and  G.  W.  Wornell,  “System,  Method,  and  Product  for  Infor¬ 
mation  Embedding  Using  an  Ensemble  of  Non-Intersecting  Embedding 
Generators,”  US  Patent  filed  Dec.  7,  1998.  (Continuation-in-part) 

26.  B.  Chen  and  G.  W.  Wornell,  “Dither  Modulation:  A  New  Approach  to 
Digital  Watermarking  and  Information  Embedding,”  in  Proc.  SPIE: 
Security  and  Watermarking  of  Multimedia  Contents,  ”  (EI’OO),  (San 
Jose),  Jan.  1999. 

27.  B.  Chen  and  G.  W.  Wornell,  “An  Information-Theoretic  Approach  to 
the  Design  of  Robust  Digital  Watermarking  Systems”  in  Proc..  Int. 
Conf.  Acoust,  Speech,  Signal  Processing,  (Phoenix),  vol.  4,  pp.  2061- 
2064,  Mar.  1999.  (invited  paper) 
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28.  B.  Chen  and  G.  W.  Wornell,  “System,  Method,  and  Product  for 
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of  Non-Intersecting  Embedding  Generators,”  US  Patent  filed  April  27, 
1999.  (Continuation-in-part) 

29.  B.  Chen  and  G.  W.  Wornell,  “Achievable  Performance  of  Digital  Wa¬ 
termarking  Systems,”  in  Proc.  Int.  Conf.  Multimedia  Computing  and 
Systems  (ICMCS’99),  vol.  1,  pp.  13-18,  Session  on  Multimedia  Data 
Security  and  Watermarking,  (Florence,  Italy),  June  1999.  (invited 
paper) 

30.  A.  M.  Chan,  “A  Class  of  Batch-Iterative  Methods  for  the  Equalization 
of  Intersymbol  Interference  Channels,”  S.M.  thesis,  MIT,  Cambridge, 
MA,  August  1999. 

31.  B.  Chen  and  G.  W.  Wornell,  “Provably  Robust  Digital  Watermarking” 
in  Proc.  SPIE,  Photonics  East  (PE’99),  Boston,  Sept.  1999,  Special 
Session  on  Image  Security,  (invited  paper). 

32.  A.  C.  Singer,  A.  V.  Oppenheim,  and  G.  W.  Wornell,  “Detection  and 
Estimation  of  Multiplexed  Soliton  Signals,”  IEEE  Trans.  Signal  Pro¬ 
cessing,  vol.  47,  no.  10,  pp.  2768-2782,  Oct.  1999. 

33.  A.  Narula,  M.  D.  IVott,  and  G.  W.  Wornell,  “Performance  Limits 
of  Coded  Diversity  Methods  for  Transmitter  Antenna  Arrays,”  IEEE 
Trans.  Inform.  Theory,  vol.  45,  no.  7,  pp.  2418-2433,  Nov.  1999. 

34.  A.  M.  Chan  and  G.  W.  Wornell,  “Block-Iterative  Equcilizers  for  Digital 
Communication  Systems,”  US  Patent  filed  March,  2000. 

35.  A.  M.  Chan  and  G.  W.  Wornell,  “A  Class  of  Block-Iterative  Equal¬ 
izers  for  Intersymbol  Interference  Channels,”  to  appear  in  Int.  Conf. 
Commun.,  (New  Orleans,  LA),  June  2000. 

36.  B.  Chen  and  G.  W.  Wornell,  “Quantization  Index  Modulation  Meth¬ 
ods  for  Digital  Watermarking  and  Information  Embedding,”  to  appear 
in  J.  VLSI  Signal  Processing  Systems  for  Signal,  Image  and  Video 
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